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Abstract 

Background, aim and scope As a food exporting nation, 
New Zealand recognises that the Global Warming Potential 
(GWP) impact of agriculture has become important to food 
customers. Food production policy and industry analysts 
make GWP decisions based on greenhouse gas inventory 
and life cycle assessment (LCA) results. For decision 
making, the level of confidence associated with information 
is important. However, treatment of uncertainty has been 
problematic in LCA, especially in agricultural systems. In 
this paper, the GWP of 1 kg of milk was used as a case 
study to test the feasibility of quantifying uncertainties by 
Monte Carlo simulation in an LCA applied to an agriculture 
product. The study also contributes to the development of 
good practice and has implications for the incorporation of 
uncertainties into decision making. 

Materials and methods We distinguished between three 
sources of variation. First, there is variability amongst basic 
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units such as dairy cattle, soils and fann characteristics 
which may be quantified by the standard deviation (SD). 
Second, there is uncertainty about true population means, 
which is typically provided by a sample and can be 
measured by the standard error of the mean (SEM). Third, 
choices, such as the time horizon for computing GWP, can 
strongly affect the LCA outcomes. The first two sources 
were analysed by compiling input variable statistics and 
undertaking Monte Carlo numerical simulations. The third 
source of variation was quantified by sensitivity analysis. 
Results Up to the farm-gate stage, the mean GWP of 1 kg of 
milk (computed over 100 years) was 0.96 kg CCL-eq. The 
associated SD was 38% of the mean when using the SD of 
input variables (and called “variability”) and 7% when 
using the SEM (and called “uncertainty”). The GWP was 
most sensitive to uncertainty of pasture dry matter intake by 
grazing cattle. The second and third key input variables 
were the cattle excreta nitrous oxide emission factor and the 
enteric fermentation methane emission factor, respectively. 
Changing the GWP from a 100-year computation to one of 
20 years corresponded to GWP increasing by 92%, while 
for a change from 100 to 500 years GWP declined by 54%. 
Discussion Data compilation for the uncertainty analyses 
was challenging because the measurements available were 
made over smaller time and space scales than ideal, so 
observations had to be generalised and data gaps filled by 
expert judgement. Uncertainty analysis using the SEM of 
input variables was considered most adapted in LCA, so it 
is recommended as best practice. Identification of the key 
parameters responsible for uncertainty in the LCA revealed 
knowledge gaps where research should be directed, such as 
for methane digestion and nitrous oxide emissions from N 
excreted by ruminants. Moreover, richer information for 
those key parameters could be used to build a typology of 
more meaningful simulations instead of a single, virtual 
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average for analysing environmental impacts of the agri¬ 
cultural system. 

Conclusions The use of Monte Carlo simulations for 
uncertainty and sensitivity analyses of LCA estimates for 
an agricultural product was feasible and recommendations 
were made. Developing a typology of realistic simulations 
based on the key parameters identified in the sensitivity 
analysis could provide decision makers with more infor¬ 
mation. Furthermore, in comparative LCA studies, a 
probabilistic framework provides further infonnation in¬ 
cluding the statistical significance of differences between 
technological options. This would represent considerable 
progress for the decision-making process. 
Recommendations and perspectives We recommend that 
uncertainty information such as SEM, when available, be 
part of inventory data for agriculture systems in public 
reports and databases including assessment of its statistical 
meaning and consistency. 

Keywords Decision making • Global warming potential ■ 
Life cycle assessment • Milk • New Zealand • Stochastic 
modelling • Uncertainty 

1 Background, aim and scope 

New Zealand has a unique profile of greenhouse gas 
(GHG) emissions amongst developed countries in being 
dominated by agriculture (-50%) (MfE 2004). Consider¬ 
able effort has gone into refining New Zealand’s agricul¬ 
tural emissions (de Klein et al. 2001, 2003, 2004; Sherlock 
et al. 2001; Clark et al. 2003; Kelliher et al. 2003, 2005) 
and exploring mitigation options (Clark et al. 2001; Ulyatt 
et al. 2002; de Klein and Ledgard 2005; de Klein et al. 
2006). However, the intensification of dairy farming is 
increasing its relative national contribution. Decision 
makers seek to understand the significance of changing 
milk production on Global Warming Potential. The Life 
Cycle Assessment (LCA) methodology has proved a 
valuable tool for the environmental evaluation of fanning 
systems (van der Werf and Petit 2002). It is usually used to 
provide a holistic picture to decision makers of the 
environmental problems attached to a product by studying 
an average or a representative system at a large scale. The 
results from LCA studies are affected by different sorts of 
variations. The first corresponds to the variation between 
the units we study such as dairy farms. This variability at a 
national scale is huge. The other sorts of variation relate to 
the different sources of uncertainty arising from the 
imperfection of the tools we use (data sets, models, choice 
and assumptions), to characterise and quantify average or 
representative LCA results for the studied system. The 
estimation of the uncertainty of the LCA results is then 


critical to allow an assessment of its significance by 
political and technical stakeholders (ISO 2000; Guinee et 
al. 2002; Gibbons et al. 2006). Different strategies have 
been developed in LCA studies of agricultural products to 
define representative systems. The first option consists of 
collecting data from one “typical” farm, experimental farm 
or from a sample of commercial farms (Cederberg and 
Mattsson 2000; Haas et al. 2001; Cederberg and Darelius 
2002; Casey and Holden 2005a; Thomassen et al. 2008). 
The statistical characteristics of the LCA results from a 
sample of farms can be calculated in addition to the average 
(Haas et al. 2001; Casey and Holden 2005a; Thomassen et 
al. 2008) but will only represent the variability of the 
studied sample. The extrapolation of these results to the 
national scale is therefore questionable. Given the impos¬ 
sibility of extrapolating these localised LCA studies of real 
farms to represent the national scale, the alternative is to 
design an average system using national statistics and 
databases (Carlsson-Kanyama 1998; van der Werf et al. 
2005; Basset-Mens and van der Werf 2005; Casey and 
Holden 2005b). With this latter approach, the degree of 
completeness of the technical data used is good but other 
sources of information are required to complete the 
inventory and the uncertainty attached to this average result 
is never quantified. Amongst all the methodologies de¬ 
scribed to quantify the uncertainty of LCA results, 
stochastic modelling receives growing attention in LCA 
studies of industrial products (McCleese and LaPuma 2002; 
Huijbregts et al. 2003; May and Brennan 2003) but has 
been scarcely applied to LCA studies on agricultural 
products (Sandars et al. 2003; Gibbons et al. 2006). 
Furthermore, the uncertainty analyses presented in those 
papers either explore the overall variability of the LCA 
result (Gibbons et al. 2006) or the uncertainty of the mean 
(Sandars et al. 2003) which are two completely different 
sorts of variation. The confusion in practice between the 
different sorts of variation (variability, uncertainty) and the 
lack of harmonisation still represent an obstacle to the im¬ 
plementation of uncertainty analyses in LCA studies on 
farming systems. As a consequence, there is an urgent need 
for developing and harmonising uncertainty analyses in 
LCA studies of agricultural products and using these 
analyses to deliver more meaningful results for all stake¬ 
holders. Taking the Global Wanning Potential of 1 kg of 
NZ milk as a case study, and working on an average 
scenario-based approach, the objectives of this paper are to: 

• quantify the uncertainty of LCA results using Monte 
Carlo simulations according to different assumptions on 
the variance of input variables 

• identify which assumption on the variance of input 
variables is most relevant to run uncertainty analyses in 
LCA studies 
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• rank the key input variables and explore the 
implications of these results for the decision-making 
process. 


2 Materials and methods 

2.1 Global wanning potential for 1 kg of average NZ milk 

The Life Cycle Assessment from “cradle-to-fann-gate” of 
1 kg of average NZ milk for the season 2004-2005 has been 
presented in another paper (Basset-Mens et al. 2009). An 
average NZ dairy farm was defined based on national 
statistics, NZ databases and model simulations. Briefly, the 
farm had 315 cows, grazing 115 ha that received 114 kg of 
nitrogen (N) fertiliser per hectare each year. The cows 
consumed annually 11,300 kg DM/ha of on-fann pasture, 
1,100 kg DM/ha of brought in feed supplements (maize and 
pasture silage produced off-farm) and produced 10,564 1 of 
milk/hectare. The replacement animals were assumed to be 
grazed off-farm. The inventory of GHG emissions for 1 kg 
of milk was based on the IPCC-NZ methodology (de Klein 
et al. 2001; Clark 2001). Methane emissions were estimated 
by multiplying the dry matter intake of cows by the emission 
factor defined by Clark (2001) (see equations and variables 
in Section 2.2). Nitrous oxide emissions were calculated by 
multiplying N inputs by specific NZ emission factors 
corresponding to the fraction emitted to the atmosphere as 
N 2 0 (de Klein et al. 2001) (see Eq. (3)). In particular, the 
emission factor of nitrous oxide from grazed pasture is 1 % in 
the NZ context compared with a default emission factor 
of 2% for the IPCC methodology. Concerning indirect 
nitrous oxide emissions, the fractions leached from 
excreta and fertilisers were according to Thomas et al. 
(2005), using the OVERSEER® nutrient budget model 
(Wheeler et al. 2003). The fraction volatilised from excreta 
and fertiliser was based on IPCC (1997). The N excreted 
from cows was calculated according to Ledgard et al. 
(2003). 

2.2 Simplified equation 

The contribution analysis of the main substances (not shown) 
was used to define a simplified equation of the GWP for 1 kg 
of milk. More than 57% of GWP was due to methane 
emissions predominantly from enteric fermentation (55%) and 
33% was due to nitrous oxide emissions from soil denitrifi¬ 
cation and nitrification processes (from on-farm pasture 
production, off-farm pasture production, maize production). 
Urea manufacturing accounted for only 3.6%, agricultural 
operations such as tractor use (fuel consumption) for 2.4% 
while electricity use contributed 1.6%. Overall, the contribu¬ 


tion from C0 2 emissions was about 10%. Methane from 
enteric fermentation and nitrous oxide emissions were 
described in detail in our simplified equation while the 
C0 2 component was defined only through one main 
variable. The latter was the C0 2 emissions from urea 
manufacturing (dependent on the urea rate), as calculated 
with the S1MAPRO software. The remaining C0 2 -equivalent 
emission was according to SIMAPRO calculation and was 
defined as a constant. This constant comprised C0 2 
emissions from some secondary processes and minor 
methane emissions from excreta on pastures and from 
dairy shed effluent. This simplified equation (Eqs. (1), 
(2), (3) and (4)) was developed in Excel and @Risk 
software, with GWP (per kg of milk) defined as an output 
and the variables of these equations defined as risk 
variables. 

GWP(/kg milk)=Eco2 x CFco2+En20 x CFn 2 o+Ech 4 x CFch 4 

( 1 ) 

where: CF c 02 =l; CF N2O =310; CF CH 4 = 21 ; E CD2 , E N2Q , 
E C H 4 are described in Eqs. (2), (3) and (4) 

Eco2 = [(Ureal + Urea2 + Urea3) x E C0 2(Urea)] + 77.6 (2) 

where: E C02( urea)= 1,480 g C0 2 /kg urea; 

Ureal urea applied to on-farm pastures in kg urea per kg 
of milk 

Urea2 urea applied to off-farm pastures in kg of urea per 
kg of milk 

Urea3 urea applied to off-farm maize in kg urea per kg of 
milk. 


E n20 = [(Nfertl + Nfert2 + Nfert3) x EFi 
+(Excreta 1 + Excreta2) x EF 3 
+((Volatf x (Nfertl + Nfert2 + Nfert3) 
+(Volat e x(Excretal + Excreta2)) x EF 4 
+(Leach x (Excretal + Excreta2 + Nfertl 
+Nfert2 + Nfert3)) x EF 5 ] x 1.571 

where: Nfertl =kg N fertiliser applied on on-farm pastures; 
Nfert2=kg N fertiliser applied on off-farm pastures; 
Nfert3=kg N fertiliser applied on off-farm maize; 

Excretal on-farm N excreta in kg N per kg of milk 
(including N excreted on the dairy shed, since it 
is directly reapplied onto pastures); 
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Excreta2 off-farm N excreta in kg N per kg of milk; 

Volatf fraction of N volatilised from fertiliser=0.10; 

Volate fraction of N volatilised from excreta=0.20; 

Leach=fraction of N leached from either 
excreta or fertiliser=0.07; 

EF ] emission factor of N 2 0 as kg N-N 2 0 per kg N 

applied from N fertiliser=0.0125; 

EF 3 emission factor of N 2 0 as kg N-N 2 0 per kg N 

applied from excreta= 0 . 01 ; 

EF 4 emission factor of N 2 0 as kg N-N 2 0 per kg N 

applied from ammonia volatilised= 0 . 01 ; 

EF 5 emission factor of N 2 0 as kg N-N 2 0 per kg N 

applied from nitrate leached=0.025 


E C h4 = (DMI1 + DMI2 + DMI3 + DMI4) x EF CH 4 (4) 

where: DM 11 = on-farm pasture dry matter intake in kg per 
kg of milk; DMI2=off-farm pasture dry matter intake in kg 
per kg of milk; DMI3=on-farm hay silage dry matter intake 
in kg per kg of milk; DMI4=on-farm maize silage dry 
matter intake in kg per kg of milk; 

EF ch4 Emission factor of methane from dry matter intake 
as g CFI 4 per kg DMI=21.6 

2.3 Probabilistic distributions of input variables 

Probabilistic distributions were defined through their 
coefficient of variation and their type of probabilistic 
function. For each risk variable, the standard error of the 
mean (SEM=SD/V«), or simply uncertainty of the mean, 


and the standard deviation (SD) were calculated or 
estimated and a probabilistic distribution was assumed 
(Tables 1 and 2). Concerning the technical data (see 
Table 1), the milk production was based on national 
statistics. The standard deviation of this variable is large 
due to the large variability of the overall population while 
the standard error of the mean is small because there were a 
lot of data and hence good information about the mean of 
the population. The on-farm dry matter intake was 
simulated using OVERSEER® model. The SD and the 
SEM for this variable were calculated using formal 
statistics and the SD or SEM of the input variables of that 
model, i.e. energy requirement of cows, energy concentra¬ 
tion of the diet and milk production. The SD of on-farm dry 
matter intake was mainly dependent on the milk SD. The 
SEM and SD of the feed supplements and N fertiliser 
use were based on a large set of data: the Dexcel 
Profitwatch database, from surveys of NZ dairy farmers, 
2000-2005. The SEM of these variables was therefore 
small but their SD was very large, especially for the feed 
supplement use, due to the variability of practices at the 
farm level. Finally, SD and SEM or uncertainty of the 
mean for off-farm variables were defined using expert 
estimates but represented only secondary variables. 
Concerning the inventory data (see Table 2), the SD of 
EF,, EF 4 and EF 5 were deduced from the ranges represent¬ 
ing 95% of the values, given by IPCC (2001). These factors 
have been based on a summary of data available in temperate 
regions and present a very large variability due to environ¬ 
mental factors, management-related factors and 
measurement-related factors (Bouwman et al. 2002). The 
SEM and SD for EF 3 were calculated from the NzOnet set of 
data (29 values), according to Kelliher et al. (2005). The 


Table 1 Coefficients of variation of the mean, total coefficients of variation and probabilistic functions assumed for the key technical parameters 


Coefficient of variation Coefficient of Reference for Probabilistic 

of the mean (SEM) b variation (SD) b SEM and SD distribution 


Milk, kg/ha/year a 

0.003 

On-farm DM pasture intake, kg/ha/year 

0.07 

Feed supplements (maize silage and 

0.03 

forage), kg DM/ha/year 


Feed supplements (hay or silage), 

0.03 

kg DM/ha/year 


On-farm pasture N fertiliser rate, 

0.013 

kg N/ha/year 


Off-farm replacement DM pasture 

0.10 

intake, kg/ha/year 


Off-farm replacement, N fertiliser 

0.10 

rate, kg N/ha/year 


Off-farm feed production, N fertiliser 

0.10 


rate, kg N/ha/year 


0.312 

LIC statistics 

Gaussian 

0.34 

Clark et al. (2003); 
Statistical calculation 

Gaussian 

1.59 

Dexcel database 

Lognonnal 

1.59 

Dexcel database 

Lognonnal 

0.649 

Dexcel database 

Lognonnal 

0.20 

Expert judgement 

Gaussian 

0.20 

Expert judgement 

Gaussian 

0.20 

Expert judgement 

Gaussian 


a Milk’s coefficient of variation is included in the calculation of the coefficient of variation of pasture DM intake 
b Expressed as a proportion of the mean 
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Table 2 Coefficients of variation of the 

mean, total coefficients of variation and probabilistic functions assumed for the inventory data 

Process 

Coefficient of 
variation of the 
mean (SEM) a 

Reference 
for SEM 

Coefficient 
of variation 
(SD) b 

Reference 
for SD 

Probabilistic 

distribution 

Kg of N 2 0-N emitted per kg of N 






Due to N fertiliser use (EF[) 

0.21 

Derived from Bouwman 
et al. (2002) 

1.02 

IPCC (2001) 

Lognormal 

Due to excreta deposited during 
grazing (EF 3 ) 

0.21 

Kelliher et al. (2005) 

1.16 

Kelliher et al. (2005) 

Lognormal 

Due to atmospheric deposition 
of NH 3 (EF 4 ) 

0.21 

Assumed to be similar to EF3 

0.45 

IPCC (2001) 

Lognormal 

Due to leaching and runoff 
of N0 3 (EF 5 ) 

0.21 

Assumed to be similar to EF3 

1.18 

IPCC (2001) 

Lognormal 

Kg of N0 3 -N emitted per kg 
of N excreted or N fertiliser applied 

0.10 

Ledgard and Waller (2001) 

0.25 

Expert judgement 

Gaussian 

Kg of NH 3 -N emitted per kg 
of N excreted 

0.14 

Sherlock’s data 

0.41 

Sherlock’s data 

Gaussian 

Kg of NH 3 -N emitted per kg 
of N fertiliser applied 

0.14 

Sherlock’s data 

0.41 

Sherlock’s data 

Gaussian 

Kg of CH 4 emitted per tonne 
of DM ingested 

0.04 

Kelliher et al. (2007) 

0.26 

Clark et al. (2003) 

Gaussian 


a Expressed as a proportion of the mean 


SEM of EFi was calculated from the Bouwman et al. (2002) 
set of data. The SEM of EF 4 and EF 5 were assumed by 
default to be the same as for EF 3 . The uncertainty of the 
mean of the fraction of N leached was deduced from 
Ledgard and Waller (2001) while its SD was estimated by 
expert judgement and corresponded to the important vari¬ 
ability of this emission over NZ pastures (soil and climate 
variability). The SEM and SD of the fraction of N volatilised 
were based on a NZ set of data (Sherlock, unpublished). The 
SEM and SD of the methane emission factor were based on 
a NZ set of data according to Kelliher et al. (2007) and Clark 
et al. (2003), respectively. For most risk variables, a 
Gaussian distribution was assumed except for the N 2 0 
emission factors for which a lognormal distribution was 
assumed as recommended by IPCC (2001) and for variables 
with a very large SD (feed supplements and N fertiliser rate) 
to avoid negative values to be selected in the simulation. 

2.4 Monte Carlo simulations and sensitivity analyses 

Uncertainty and sensitivity analyses were performed with 
@Risk package (Palisade Corporation 2002). Two Monte 
Carlo simulations, specifically Latin Hypercube simulations, 
were run: 

• one using the standard error of the mean (or uncertainty 
of the mean) as uncertainty interval for each key 
parameter, and called “Uncertainty” 

• one using the standard deviation, reflecting the inherent 
variability of the parameter across farms, and called 
“Variability” 


Latin Hypercube simulations (LHS) were preferred 
because they use a technique of stratified sampling without 
replacement which allows for a quicker stabilisation of the 
results’ function. Each model run consisted of 5,000 
iterations (assuming independent variables). An uncertainty 
analysis assuming correlation factors between key variables 
on the basis of expert advice was also run (not shown). The 
final uncertainty of the GWP result was larger when 
assuming correlations between key variables. For the 
sensitivity analysis, we used the regression coefficients 
proposed by the @Risk software which measure for each 
input variable the sensitivity of the output to that particular 
input distribution. In this sensitivity analysis, the overall 
contribution of the uncertainty of each input variable to the 
uncertainty of the output is assessed. This therefore 
includes both the uncertainty of a given input variable and 
its sensitivity in the model. 

3 Results 

3.1 Frequency distributions of GWP for 1 kg of average NZ 
milk 

For each simulation run, the mean GWP of 1 kg of milk 
was about 962 g C 02 -eq. The standard deviation of this 
result obtained with the “uncertainty” analysis was about 
7% while it was 38% with the “variability” analysis. The 
“uncertainty” distribution was very slightly skewed (skewness 
of 0.23) while the “variability” distribution was significantly 
skewed (skewness of 1.7) (Fig. 1). The range of values 
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g C02-eq/kg of milk 


Fig. 1 Frequency distributions of GWP of 1 kg of milk for the 
average NZ farm according to “Uncertainty” and “Variability” 
analyses 


Table 3 Regression coefficients and ranking orders of the most 
influential input variables for the “Uncertainty” and the “Variability” 
analyses 


Parameters 

Regression 

coefficients 

with 

“Uncertainty” 

analysis 

Ranking 

order 

Regression 

coefficients 

with 

“Variability” 

analysis 

Ranking 

order 

On-fanu DM 

0.697 

1 

0.608 

1 

intake 

ef 3 

0.547 

2 

0.553 

2 

EF C H4 

0.323 

3 

0.376 

3 

Off-fann DM 

0.203 

4 

0.077 

9 

intake 

EF! 

0.200 

5 

0.187 

5 

EF 4 

0.126 

6 

0.047 

10 

ef 5 

0.123 

7 

0.132 

6 


obtained with the “uncertainty” analysis was 745-1197 g 
C0 2 -eq/kg of milk. From this analysis, the upper 95% 
confidence limit for GWP per kg of milk was 1,073 g C0 2 - 
eq and 90% of values were in the interval -11% to +12% 
around the mean. With the “variability” analysis, the range of 
values obtained was 125^4,672 g C0 2 -eq/kg of milk and the 
upper 95% confidence limit for GWP per kg of milk was 
1,582 g C0 2 -eq. Ninety percent of values in this analysis 
were in the interval -48% to +64%. 

3.2 Ranking of key parameters regarding their contribution 
to the uncertainty of results 

In the sensitivity analysis from @Risk, a normalised 
multiple regression coefficient of 0 indicates no relationship 
between the input and output, while a value of 1 or -1 
indicates a 1 or -1 standard deviation change in the output 
for a 1 standard deviation change in the input. In both 
analyses, the three key input variables were the same and 
were ranked in the same order (Table 3). 

They were: 

• On-farm dry matter intake 

• EF 3 (emission factor for nitrous oxide due to excreta 
deposited during grazing) 

• EF C h 4 (emission factor for methane emitted by cows 
during digestion) 

This was consistent with previous uncertainty analyses 
conducted for the separate inventory of nitrous oxide and 
methane emissions in NZ (Sherlock et al. 2001; Clark et al. 
2003; Kelliher et al. 2007). Since the regression coefficients 
include both the uncertainty of the input variables and their 
sensitivity in the model, this ranking is also explained by the 
role of these parameters in the GWP model. In our model, 
the on-farm DM intake was the largest part of the DM intake 


of cows and was included in the calculation of the two key 
components of our model output: the methane and the 
nitrous oxide components (as commented in Section 2.2 
regarding the contribution analysis of the GWP). This is why 
this input variable was identified as the first variable 
contributing to the uncertainty of the output and the emission 
factors used to calculate the nitrous oxide (EF 3 ) and methane 
emissions (EF C h 4 ) were logically the next key parameters to 
which both the result and its uncertainty were sensitive. 

4 Discussion 

4.1 Use of Monte Carlo simulations to quantify uncertainty 
of LCA results for fanning systems and contribution to 
harmonised practice 

The objective of this paper was firstly to test and examine 
Monte Carlo simulations to quantify the uncertainty of 
LCA results of agricultural products, using the GWP of 
1 kg of NZ milk as a case study. In one analysis, the 
standard deviation of each key input variable was used 
while in the other, the uncertainty of the mean was used 
(standard error of the mean calculated or estimated) to 
characterise the probabilistic distributions of each input 
variable. As already highlighted by several authors 
(Payraudeau et al. 2007; Bjorklund 2002; Heijungs and 
Huijbregts 2004), the lack of information on the uncertainty 
of data is an important difficulty for the development of 
uncertainty analyses in general. This problem is even more 
critical for Monte Carlo simulations where one needs to 
define a probabilistic distribution for all input variables 
(Payraudeau et al. 2007). The lack of statistics for inventory 
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data (SD, SEM, confidence interval or total range) results in 
an additional and time-consuming phase for estimating their 
probabilistic functions according to a range of means: using 
a set of data, literature references or by default, expert 
judgement. Furthermore, this discrepancy in the quality of 
the information on the uncertainty of input variables (e.g. 
on-farm and off-farm DM intakes in our analysis) can result 
in inconsistencies in the analysis. However, the systematic 
practice of presenting confidence intervals for data is 
increasing (IPCC 2001; Dones et al. 2005; Frischknecht et 
al. 2005) and should be encouraged (Payraudeau et al. 
2007). Although challenging, the two different uncertainty 
analyses using Monte Carlo simulation were feasible. 
However, their meaning is different. The “variability” 
analysis corresponds to variability among units including 
dairy cattle, farms, soils and climate. The “uncertainty” 
analysis, on the contrary, is an estimate of the imprecision 
of our average result due to the different and cumulated 
uncertainties in our input estimates. It tells how confident 
we are in this average result. The “variability” cannot be 
reduced since it refers to the real variability of GWP of 
dairy farms at the NZ scale. The “uncertainty” can 
potentially be reduced through the improvement of our 
data and precision of tools. From a decision-maker per¬ 
spective, the existence of the natural variability is known 
but when attached to a result it does not help them make a 
decision. Generally speaking, in LCA studies, decision 
makers need to base their judgement on representative 
scenarios at various scales for which the results are known 
with a sufficiently good level of confidence. The “uncer¬ 
tainty” analysis as presented in this study appears more 
logical for LCA studies and interesting for decision 
makers. However, the “variability” analysis potentially 
reveals some potential for improvements of the GWP of 
dairy farms. Analysing the conditions in terms of practice 
and natural conditions leading to the lowest GWP per kg 
of milk could also be helpful to make decisions such as the 
identification of the most favourable regions where pro¬ 
ducing milk. 

These analyses only accounted for the uncertainty/ 
variability of parameters and data. Uncertainty due to choice 
of the time horizon was taken into account through a 
sensitivity analysis using the set of characterisation factors 
calculated by Houghton et al. (1996) for the time horizons of 
20 and 500 years in addition to the reference horizon of 
100 years. Comparing this range of results with the 
“uncertainty” interval or even the “variability” interval due 
to inventory data (see Section 3.1) (indicated by the 5% and 
95% percentiles from the @Risk software calculations), the 
choice of time horizon resulted in the largest variation, from 
-54% to +92% around the average result (not shown), 
against -11% to +12% for the “uncertainty” and -48% to 
+64% for the “variability”. 


4.2 Deliver more meaningful results to stakeholders 

Another purpose of this study was to analyse the 
implications of these results for the decision-making 
process. Both “uncertainty” and “variability” analyses 
allowed us to produce an LCA result for the GWP 
impact as a probabilistic distribution. In addition to the 
mean, a range of probable results can be presented with 
a certain degree of confidence. As a rule, we consider 
this presentation of LCA results is extremely valuable 
for decision makers who need to know the robustness 
of the assessment of alternative systems such as new 
technologies and the risk attached to their decisions. We 
also consider, as part of more transparent LCA studies, 
that the choice of the degree of confidence can be left 
to decision makers. The ranges of results for different 
degrees of confidence could be presented to them to 
support their decision and to help them determine an 
acceptable level of risk (which might often be less than 
95%). Moreover, using the “uncertainty” analysis as 
recommended in this study would often lead in practice 
to a clear ranking between two technological options, 
the uncertainty interval reinforcing the meaning of the 
results. Conversely, when using the “variability” analy¬ 
sis, the interval would be large and would add 
confusion to the decision-making process. 

In view of producing more meaningful results, the key 
parameters identified in the sensitivity analysis were used to 
differentiate the average scenario. The methane emission 
factor was not used in this differentiation process since the 
current estimate already corresponds to the best knowledge 
available in NZ and the set of data could not be 
differentiated further. Realistic scenarios were designed 
and assessed by differentiating different soil drainage 



Fig. 2 Cumulative probability distributions of GWP (using “Uncer¬ 
tainty” analysis) for average, poorly drained soil and free drained soil 
scenarios of dairy farm 
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classes (poorly drained versus free draining soil situations), 
a real parameter influencing both remaining key variables: 
on-farm DM intake and EF 3 in our case study. The 
measurement data collected in the NzOnet study (de Klein 
et al. 2004) were used for differentiating EF 3 . Pasture yield 
was adjusted for each soil situation based on expert 
judgement. The cumulative probability curves of the 
GWP, using the “uncertainty” analysis, are presented in 
Fig. 2 for the two differentiated and the average scenarios. 
According to this analysis, the probability that the GWP for 
the free drained scenario is different from the GWP for the 
poorly drained scenario was around 70%. Although we can 
consider these results (see Fig. 2) and their corresponding 
mean and attached uncertainty more meaningful than a sole 
average result, the differentiation process was also shown to 
be limited by existing data. 

As presented in this paper, LCA results are affected by 
different sources of variation which require specific 
methods to be evaluated. Uncertainty due to data can be 
addressed through Monte Carlo simulations while uncer¬ 
tainty due to choices requires the effect on results of each 
choice to be tested in a sensitivity analysis. Although these 
different uncertainty analyses cannot be aggregated into a 
single uncertainty interval, they give different perspectives 
to decision makers. Furthermore, choices such as time 
horizon for computing characterisation factors can be seen 
as arbitrary and therefore the uncertainty analysis due to 
data can either be repeated for each arbitrary choice of time 
horizon or their choice can be made arbitrarily and 
transparently for one given analysis. In studies where the 
CO 2 emissions contribution to GWP is high, the effect of 
the time horizon would be less compared to studies where 
the methane and nitrous oxide components are paramount. 
This is explained by the conversion of methane or nitrous 
oxide into carbon dioxide after the end of their life time in 
the atmosphere which, over a long period of time, 
diminishes their GWPi. 


5 Conclusions and recommendations 

Taking the GWP of 1 kg of average NZ milk as a case 
study, stochastic modelling has been applied and dis¬ 
cussed in this paper. This approach could similarly be 
implemented to other important impact categories within 
an LCA study such as eutrophication, energy use and 
acidification. There would however be a need for 
accounting in the model for the interactions between 
these different impact categories. The difficulties of 
defining probabilistic distributions for input variables of 
LCA studies have been highlighted, reflecting imperfec¬ 
tions in such analyses. Nevertheless, the diagnoses were 
valuable and there is increasing availability of informa¬ 


tion on the uncertainty of data and of user-friendly 
analysis tools (e.g. @Risk; S1MAPRO). Our study 
showed that applying stochastic modelling to LCA 
studies of agricultural products was possible and could 
probably be developed in a routine way for LCA studies 
in the near future, it is however critical to make sure that 
uncertainty intervals presented in the databases have 
clear and defined meanings. This study suggested the 
standard error of the mean (or uncertainty of the mean) 
was most adapted and informative for LCA studies and 
can contribute to reconcile decision makers with uncer¬ 
tainty. When data are available, a differentiation process 
could be explored to deliver more meaningful results. 
Both the uncertainty analysis and the differentiation 
process are strongly dependent on the existence of good 
sets of data for key variables at the national scale. 
Regarding the GWP of 1 kg of NZ milk, and despite the 
existence in NZ of one of the most comprehensive sets 
of data on methane digestion and nitrous oxide emissions 
from N excreted by ruminants, our findings support the 
need for further research in these two areas to reduce 
uncertainty. 
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